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1.  Introduction 


In  2012,  the  US  Army  Research  Laboratory  (ARL)  developed  an  Android  app  called  the  Medical 
Phrasebook  to  serve  as  a  bilingual  English-Dari  glossary  of  more  than  6000  technical  medical 
terms/  Since  then,  new  enhancements  (e.g.,  Pashto  texts,  military  terms,  additional  Dari  terms, 
etc.)  were  added  to  the  Phrasebook  app.  In  2014,  we  wanted  to  add  text-to-speech  (ITS) 
capability  to  the  app.  Implementing  an  English  TTS  was  trivial  because  a  mature  English  TTS 
was  available  in  the  Android’s  TTS  application  programming  interface  (API).  Not  surprisingly, 
neither  Dari  nor  Pashto  was  included  in  the  Android’s  TTS  API.  After  searching  in  academia  and 
the  research  community,  we  found  an  open-source  TTS  Engine  called  Eestival  Eite  with  Dari 
language  support  developed  by  Carnegie  Mellon  University  (CMU). 

Eestival  Eite  (Elite)  is  a  smaller  footprint  version  of  a  speech  synthesis  framework  called 
Eestival.  Elite  is  commonly  used  by  developers  to  create  custom  TTS  engines.  It  works  well  as  a 
standalone  application  in  Einux  and  Windows.  It  is  easy  to  use,  requires  few  resources,  and 
synthesizes  voices  very  quickly.  To  provide  Elite  to  a  wider  audience.  Elite  has  been  ported  to 
the  Android  platform  by  an  open  source  project  called  the  Elite  Android  Engine.  The  Elite 
Android  Engine  does  not  attempt  to  rewrite  the  Elite  engine  in  Android;  it  is  simply  a  Google 
TTS  wrapper  for  Elite  and  actually  requires  Elite  to  be  present  at  compile  time.  The  Elite 
Android  Engine  has  a  user  interface  that  allows  users  to  download  and  select  voices  from  a  list 
and  also  a  demo  page  that  lets  a  user  synthesize  a  voice  from  text. 

We  searched  for  instructions  on  how  to  integrate  the  Dari  TTS  library  to  the  Elite  Android 
Engine,  but  there  were  few  resources  describing  this  process  and  some  posted  instructions  did 
not  produce  expected  results.  This  integration  was  not  an  intuitive  task  due  to  the  fact  that  the 
Elite  Android  Engine  did  not  have  an  easy  way  to  manually  integrate  new  language  (e.g.,  Dari, 
Pashto)  libraries.  With  a  continuously  evolving  state  and  various  development  versions  of  Elite, 
we  encountered  various  obstacles  migrating  the  Elite  Dari  library  to  the  Android  platform.  Our 
issues  may  have  been  related  to  the  specific  Elite  Engine  version  we  worked  with.  The  latest 
available  version  of  Elite  Engine  is  1.9.0,  while  the  Elite  Android  Engine  instructions  describe 
integrating  with  Elite  Engine,  version  1.5.6. 

Depending  on  the  version  of  Elite  and  the  Elite  language  to  be  integrated,  other  developers  may 
not  encounter  the  same  issues  we  describe  in  this  report.  At  the  time  of  our  migration  work,  there 
was  no  comprehensive  documentation  explaining  this  process.  Many  troubleshooting  emails 
were  sent  back-and-forth  with  Dr  Alan  Black  (the  primary  developer  of  Elite)  and  Dr  Alok 
Parlikar  (the  primary  developer  of  the  Elite  Android  Engine)  to  resolve  these  issues.  In  this 
report,  we  document  the  information  learned  from  the  email  exchanges  with  the  Elite  Engine  and 
Elite  Android  Engine  developers,  a  step-by-step  process  of  migrating  the  Elite  Dari  library  from 
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a  desktop  platform  to  an  Android  platform,  and  finally,  the  proeess  of  how  we  integrated  the 
Flite  Dari  TTS  eapability  to  the  ARL  Phrasebook  Android  app. 


2.  Two  Types  of  Dari  Voices  -  Clunit  and  Clustergen 


There  are  two  versions  of  Dari  voiees  available  from  CMU:  Clunit  and  Clustergen.  Clunit  (Unit 
Seleet)^  and  Clustergen  (statistieal  parametrie  synthesis)"^  are  two  TTS  voiee  building/synthesis 
teehniques.  Both  voiees  work  very  well  as  standalone  applieations  on  Linux  and  Windows. 
Aeeording  to  the  ARL’s  in-house  Dari  linguist,  Ghulam  Jahed,  the  Dari  Unit  Seleet  voiee  was 
superior  to  Dari  Clustergen  voiee — Dari  Unit  Seleet  sounded  more  natural  than  Dari  Clustergen. 

Unfortunately,  this  report  does  not  focus  on  Dari  Unit  Select,  because  we  were  not  able  to 
successfully  migrate  it  to  Android  due  to  a  very  specific  “Libc  Fatal  Signal”  error  thrown  by  the 
Dari  Unit  Select  library.  According  to  Dr  Parlikar,  the  migration  process  for  both  types  of  voices 
is  very  similar,  and  most  of  the  instructions  described  here  are  applicable  to  Dari  Unit  Select  as 
well. 

Even  though  we  do  not  address  Dari  Unit  Select  in  this  report,  we  provide  useful  information 
(when  appropriate  to  the  topic  of  discussion)  that  pertains  specifically  to  Dari  Unit  Select  that  we 
gathered  from  our  effort  that  may  help  other  developers  who  attempt  to  migrate  Dari  Unit  Select 
to  an  Android  platform. 


3.  Enabling  Dari  on  Flite  Engine  1.5.6  and  Compiling  Flite  Engine  1.5.6 


Our  interest  was  in  specifically  migrating  Dari  to  the  Android  platform.  Dr  Black  provided  us 
with  a  29-MB  Flite,  version  1.9.0  (configured  for  Dari  and  Pashto),  and  two  variations  of  the 
Dari  voice,  a  4.12-GB  Unit  Select  and  a  784-MB  Clustergen.  (Note:  We  were  told  the  migration 
process  to  Android  was  the  same  for  Unit  Select  and  Clustergen;  however,  we  were  not  able  to 
migrate  the  Unit  Select  voice  to  Android.) 

We  were  able  to  set  up  Flite  1.9.0  and  synthesize  both  Dari  voices  as  a  standalone  application  on 
Windows  and  Linux.  Later  during  the  migration  effort,  we  ran  into  a  software  bug  specific  to 
Elite,  version  1.9.0.  Although  the  Android  Elite  Engine  had  basic  functionality  (e.g.,  display 
About  Elite,  download  voices,  set  voices,  switching  system  TTS  to  Elite,  and  Demo  GUI,  etc.),  it 
was  not  able  to  “set  language”  using  the  Elite  1.9.0  native  library.  Without  the  ability  to  set  the 
language,  the  Android  Elite  Engine  could  not  synthesize  any  voice.  We  circumvented  this 
software  bug  by  working  with  Dr  Black  to  extract  the  Dari  capability  from  Elite  1.9.0  and 
integrate  it  to  Elite  1.5.6,  which  was  known  to  be  compatible  with  the  Android  Elite  Engine.  This 
extraction  and  integration  process  only  enables  the  Elite  1.5.6  engine  to  link  with  Dari  voices. 
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The  Dari  voices  then  have  to  be  compiled  separately.  We  describe  the  Dari  extraction  and 
integration  process  in  this  section. 

1,  Download  Flite  1,9.0  and  1,5,6. 

Please  contact  Dr  Alan  Black  at  CMU^  for  instructions  on  downloading  Flite  1.9.0  and  the 
Dari  voice  libraries.  Flite,  version  1.5.6,  is  available  for  download  from  CMU  TTS  Web 
page.^  This  report  focuses  on  migrating  Dari  to  Android,  but  the  version  of  Flite  1.9.0  we 
received  was  configured  for  Dari  and  Pashto.  As  we  extracted  the  Dari  capability  from 
Flite  1.9.0,  we  extracted  Pashto  as  well. 

2,  Extract  Flite  1.9,0  and  1.5,6  to  disk. 

For  basic  setup  and  standalone  operation,  the  Flite  TTS  Engine  can  be  compiled  on  either 
Linux  or  Cygwin  (i.e.,  Windows).  But  we  recommend  performing  these  steps  on  a  Linux 
system  from  the  beginning  because  certain  steps  that  are  required  later  in  the  Android 
migration  effort  do  not  work  in  Cygwin  and  require  in-depth  troubleshooting.  It  is  much 
easier  to  develop  and  proceed  this  application  in  Linux.  We  chose  to  develop  on  a  64-bit 
Ubuntu  Linux.  Perform  the  following  steps: 

•  Extract  Elite  1.9.0  to  “/Llite/flite- 1.9. 0-current”. 

•  Extract  Elite  1 .5 .6  to  “/Elite/flite- 1 .5 .6-current_w_l  .9.0_Dari_Pashto”. 

Eor  the  remainder  of  this  report,  “/Elite/flite-1.5.6-current_w_1.9.0_Dari_Pashto”  is 
referenced  as  <ELITE_HOME>. 

3,  Copy  1,9,0’s  Dari  and  Pashto  “lang”  files  to  1,5.6. 

Perform  the  following: 

cp  /Flite/f lite-1 . 9 . 0-current/lang/cmu  dari_lang/  <FLITE  HOME>/lang 

cp  /Flite/flite-1 . 9 . 0-current/lang/cmu_dari_lex/  <FLITE  HOME>/lang 

cp  /Elite /flite -1.9. 0- cur rent/ lang/ cmu_pashto_lang/ <FLITE  HOME>/ lang 

cp  /Flite/f lite-1 . 9 . 0-current/lang/cmu__pashto_lex/  <FLITE  HOME>/lang 

cp  /Elite /flite -1.9. 0- cur rent/ lang/ cmu_us_kal/  <FLITE_HOME>/ lang 

cp  /Elite /flite -1.9. 0- cur rent/ lang/ cmu_us_rms/  <FLITE_HOME>/ lang 

Although  “cmu_us_kal”  and  “cmu  us  rms”  are  English  voices,  they  must  be  copied  to  Elite 
1.5.6  as  well.  Otherwise,  the  directories’  absence  will  cause  an  error  during  the  make  process. 

4,  Configure  and  compile  Flite  1,5,6  Engine, 

Perform  the  following: 

Copy  "transtac.lv"  from  Flite  1.9.0  if  it  does  not  already  exist  in  Flite  1.5.6. 

cp  /Elite /flite -1.9. 0- cur rent/ con fig/ transtac . Iv 

<FLITE_HOME>/config 
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Generate  a  new  “config”  file  for  Flite  1.5.6. 


The  Dari  configured  Flite  TTS  Engine  we  used  required  a  special  parameter.  Use  the 
with-langvox=transtac”  parameter  to  generate  a  new  “config”  file  and  compile  Flite 
1.5.6. 

cd  <FLITE_HOME> 

.  / configure  --with-langvox=transtac 
make 


This  command  will  generate  a  “<FLITE_HOME>/config/config”  file  with  the  correct 
“langvox”  value  we  need. 

After  successful  compilation,  there  will  be  new  binaries  in  the  “<EEITE_HOME>/bin” 
folder. 

Elite  1.5.6  is  now  able  to  link  with  a  Dari  voice.  Einking  a  Dari  Clustergen  voice  to  this 
Elite  1.5.6  installation  is  described  in  the  next  section.  However,  Elite  1.5.6  is  shipped  with 
the  ability  to  synthesize  English  text  immediately  after  compilation. 

5,  Verify  Flite  TTS  Engine  with  English  voice  synthesis. 

If  Elite  TTS  Engine  was  installed  correctly,  it  should  speak  the  following  text: 

cd  <FLITE_HOME> 

./bin/flite  "Flite  is  a  small  fast  run-time  synthesis  engine" 
input_text  Flite  is  a  small  fast  run-time  synthesis  engine 

On  Einux,  the  above  command  may  display  an  error  message  if  the  Open  Sound  System 
(OSS)  package  is  not  available: 

"oss_audio:  failed  to  open  audio  device  /dev/dsp". 

This  error  message  does  not  indicate  a  problem  with  Elite  TTS  Engine  and  is  remedied  by 
installing  OSS  on  the  target  Einux  platform.  Unless  OSS  is  set  up  in  Einux,  a  synthesized 
voice  will  not  play. 

An  alternative  way  to  test  Elite  is  to  generate  a  WAV  file  (8  KHz  riff  headered  waveform) 
of  the  text: 

cd  <FLITE_HOME> 

./bin/flite  "Flite  is  a  small  fast  run-time  synthesis  engine" 
testing . wav 

input_text  Flite  is  a  small  fast  run-time  synthesis  engine 

This  command  generates  “testing.wav”  in  the  <EEITE_HOME>  folder. 
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4.  Linking  Dari  Clustergen  Voice  to  Flite  1.5.6 


The  previous  seetion  deseribed  enabling  Dari  (and  Pashto)  on  Flite  1.5.6.  Enabling  Dari  only 
means  that  Flite  1.5.6  is  able  to  link  with  the  Dari  voice  library.  Flite  1.5.6  still  requires  the  Dari 
voice  library  and  cannot  synthesize  a  Dari  voice  on  its  own.  This  section  describes  linking  the 
Dari  Clustergen  voice  library  to  the  Dari-enabled  Flite  1.5.6. 

1,  Download  Dari  Clustergen. 

Please  contact  Dr  Alan  Black^  at  CMU  for  instructions  on  downloading  the  Dari  voice 
libraries. 

2,  Extract  Dari  Clustergen  to  disk. 

Once  the  Dari  Clustergen  archive  is  downloaded,  extract  the  archive  to  disk.  We  extracted 
the  Dari  Clustergen  to  “/Flite/cmu_dari_transtac_male_cg3”.  For  the  remainder  of  this 
report,  “/Flite/cmu_dari_transtac_male_cg3”  is  referenced  as  <DARI_CG3_HOME>. 

3,  Configure  Dari  Clustergen, 

Dari  Clustergen  needs  to  know  where  Flite  1.5.6  is  located.  Open  the  Makefile  located  at 
“<DARI_CG3_HOME>/fiite/Makefile”  with  a  text  editor  and  update  line  33.  Replace  the 
existing  line 

FLITEDIR=/home/ awb/projects/ arl/ flite/ 

with  the  path  to  Flite  1.5.6 

FLITEDIR=/Flite/ f lite-1 . 5 . 6-current_w_l . 9 . 0_Dari_Pashto/ 

4,  Compile  the  Dari  Clustergen  voice. 

Use  the  following  commands  to  compile  the  Dari  Clustergen  voice: 

cd  <DARI_CG3_HOME>/ flite/ 

make  clean 

make 

Successful  compilation  creates  several  new  fdes,  including 

“flite_cmu_dari_transtac_male_cg3”,  under  the  “<DARI_CG3_HOME>/fiite”  folder. 

5,  Verify  the  Dari  Clustergen  voice. 

If  Dari  Clustergen  was  installed  correctly,  it  should  synthesize  a  Dari  voice  using  a  sample 
Dari  text  file  (included  with  the  Dari  distribution).  Again,  OSS  is  required  to  hear  the 
synthesized  Dari  voice.  The  sample  text  file  command  is  as  follows: 
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cd  <DARI_CG3_H0ME> 

. /f lite/f lite_cmu_dari_transtac_male_cg3  -f  dari.txt 

This  test  command  takes  several  minutes  to  complete  because  the  Dari  sample  file  contains 
more  than  160  lines  of  Dari  text.  Developers  may  wish  to  delete  the  majority  of  the  lines  to 
reduce  the  processing  time.  Figure  1  shows  a  Dari  sample  text  file. 


2 


3 

4 

5 


Fig.  1  Dari  sample  text  file  included  in  the  Dari  Clustergen  distribution 


5.  Android  Development  Tool  (ADT)  and  Android  Native  Development  Kit 
(NDK)  Setup 


Before  any  Android  project  can  be  compiled,  an  Android  development  environment  needs  to  be 
set  up.  There  are  several  ways  to  compile  an  Android  app.  We  chose  to  develop  our  app  using 
the  Android  Development  Tool  (ADT)  and  Eclipse.  Both  are  packaged  as  a  single  download  and 
are  available  from  the  Android  developer  Website.^  This  report  assumes  that  both  ADT  and 
Eclipse  are  used  as  the  Android  Integrated  Development  Environment  and  are  installed  correctly 
to  compile  an  Android  project.  In  addition  to  ADT  and  Eclipse,  the  Android  Native  Development 
Kit  (NDK)  is  required  to  invoke  C/C++  methods  used  in  the  Android  Elite  Engine.  The  Android 

o 

NDK  is  also  available  from  the  Android  developer  Website.  ADT  and  NDK  setup  instructions 
and  troubleshooting  help  are  widely  available  so  this  report  does  not  describe  them.  Eor  the 
remainder  of  this  report,  we  reference  “<ADT_HOME>”  as  where  ADT  was  extracted,  and 
“<NDK_HOME>”  as  where  NDK  was  extracted. 

After  ADT  and  NDK  are  set  up,  one  must  add  the  following  environment  variables  to  the 
system; 

export  FLITEDIR=/Flite/ flite-1 . 5 . 6-current_w_l . 9 . 0_Dari_Pashto 
export  FLITE_APP_DIR=/home/ arl /workspace/ FI iteEngine 
export  ANDROID_NDK=/Development/ android-ndk-r9d 

export  ANDRO I D_SDK=/ Development/ adt-bundle-linux-x86_64-20 140321/ sdk 

The  environment  variable  “FLITE  APP  DIR”  is  the  path  to  the  Android  Flite  Engine 
application.  Up  until  this  point,  we  have  not  discussed  the  Android  Elite  Engine  application  in 
detail.  Eor  now,  one  should  create  an  environment  variable  that  points  to  the  folder  where  the 
Android  Flite  Engine  project  will  be  saved.  This  is  shown  in  the  second  command  listed  above. 
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As  part  of  the  ADT  download,  the  Eelipse  Integrated  Development  Environment  (IDE)  is 
downloaded  as  well.  The  Eclipse  launcher  is  located  at  <ADT_HOME>/eclipse/eclipse.  We 
chose  this  included  version  of  Eclipse  to  develop  the  Android  Elite  Engine,  because  it  is  already 
preconfigured  for  Android  development.  Please  verify  Eclipse  is  able  to  launch  without  any 
errors,  and  use  the  built-in  Android  SDK  Manager  (Eig.  2)  to  download  recent  versions  of 
Android  SDK  tools  before  continuing. 


[e  Navigate  Search  Project  Run  Window  Help  | 

:  .  t  a  Js  T  . :  ■0 :  .  o ' (t  ’ ;  i 

Sr  Gr  »  &  --y 

■  Android  SDK  Manager 

1  Packages  Tools 

SDK  Path: 
Packages 


'll'  Name 

API 

Rev. 

Status  1 

^  Tools 

■  Android  SDKTools 

22.6.3 

■  Update  available:  rev.  22.6.4 

Android  SDK  Platform-tools 

19.0.2 

^  Installed 

^  Android  SDK  Build-tools 

19.1 

^  Installed 

^  Android  SDK  Build-tools 

19.0.3 

^  Installed 

V*  Android  SDK  Build-tools 

19.0.2 

^  Installed 

Show:  ®  Updates/New  ■'Installed  □  Obsolete  Select  New  or  Updates  Inst 


[  Sort  by:  •  API  level  Repository  Deselect  All  Delt 

O 

I  Done  loading  packages. 


Fig.  2  Android  SDK  Manager  included  in  Eclipse 


6.  Compiling  Dari  Clustergen  Library  for  Multiple  CPU  Architectures 


Most  Android  devices  run  on  ARM  processors  instead  of  x86  processors.  Typically,  a  developer 
is  not  concerned  about  this  aspect  when  creating  an  Android  app,  because  the  Android  compiler 
will  automatically  build  for  multiple  target  processors  and  shelter  developers  from  this  process. 
However,  when  an  Android  app  imports  and  invokes  an  external  native  library,  this  library  must 
be  compiled  for  multiple  central  processing  unit  (CPU)  architectures.  Eortunately,  Dr  Black  and 
his  team  have  designed  Makefile  so  that  it  can  compile  for  various  CPU  architectures.  This 
part  of  the  migration  effort  is  the  most  lengthy  and  repetitive  process,  because  it  requires  several 
steps  for  each  CPU  type  and  we  need  to  compile  for  multiple  architectures.  In  this  section,  we 
describe  step-by-step  instructions  on  how  to  compile  the  Dari  Clustergen  library  for  armeabi, 
armeabivVa,  x86,  and  Mips.  The  key  information  here  is  that  the  CPU  target  for  Elite  1.5.6  is  also 
the  target  to  use  when  compiling  the  Dari  Clustergen  voice  (i.e..  Elite  1.5.6  must  be  compiled 
first  and  then  Dari  Clustergen  compiled  immediately  afterwards). 
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1,  Miscellaneous  pre-conditions 


Flite  1.5.6  was  shipped  pre-configured  to  compile  on  32-bit  Linux  using  Android  GCC, 
version  4.4.3.  If  the  developer  is  not  using  the  same  combination,  compilation  will  throw 
the  following  “Command  not  found”  exception; 

make [2 ] :  /Development/ android-ndk-r9d/ tool chains/ arm-linux-androideabi- 
4 . 4 . 3/prebuilt/linux-x8 6/bin/arm-linux-androideabi-gcc :  Command  not  found 
make[2]:  ***  [../.. /build/armeabi-android/obj /src/audio/auclient . o]  Error 
127 

make[l]:  ***  [.. /build/armeabi-android/obj /src/ .make_build_dirs]  Error  2 
make:  ***  [build/armeabi-android/obj // .make_build_dirs]  Error  2 

We  developed  on  64-bit  Linux  and  Android  GCC,  version  4.8,  so  we  had  to  update 
<FLITE_HOME>/configure.in  with  the  correct  paths  before  compiling  the  Dari  Clustergen 
for  other  CPU  architectures.  The  collection  of  installed  Android  C  Compilers  are  viewable 
by  listing  files  in  the  “$ANDR01D_NDK/toolchains”  folder  (Eig.  3).  Android  C  Compiler 
versions  are  indicated  by  the  suffix  of  subdirectory  names.  Eor  example,  our  Android  NDK 
contained  Android  C  Compiler  versions  4.6  and  4.8. 


B  /Development/android-ndk-r9d/toolchains/ 

Name  ▼ 

Size 

I-  B  arm-iinux-androideabl-4.6  J 

3  items 

>  B  arm-linux-androideabt-4.8  ] 

3  items 

r  B  arm-linux-androideabi-clang3.3 

2  items 

'  B  arm-linux-androideabi-clang3.4 

2  items 

^  !  k  .  ..  - 

Fig.  3  Android  C  Compiler  versions  listed  in  $ANDROID_NDK/toolchains 

Make  the  following  three  changes  to  <EElTE_HOME>/configure.in. 

At  line  157  (actual  line  number  may  vary),  replace  the  line 

ANDROID_GCC_VERSION=4 .4.3 

with 

ANDROID_GCC_VERSION=4 . 8 

At  line  180  (actual  line  number  may  vary),  replace  the  line 

ANDROIDBIN="$ANDROID_NDK/toolchains/x86- 

$ANDROID_GCC_VERSION/prebuilt/linux-x8  6_64 /bin/ 168  6-android-linux" 

with 

ANDROIDBIN="$ANDROID_NDK/toolchains/x86- 

$ANDROID  GCC  VERS lON/prebuilt /linux-x8 6  64/bin/|i686-linux-androij" 
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Globally  replace  the  string 

linux-x8  6 


with 

linux-x8  6_64 

There  should  be  four  occurrences. 

The  following  is  an  example  of  the  line  that  was  updated; 

ANDROIDBIN=" $ANDROID  NDK/ toolchains/ arm-linux-androideabi- 
$ANDROID_GCC_VERSION/prebuilt/linux-x8  6_64 /bin/ arm-linux-androideabi" 

De-reference  the  environment  variables  and  make  sure  that  the  referenced  paths  exist  on 
disk. 

After  <FLITE_HOME>/conligure.in  is  updated,  Elite  must  be  reconfigured  using  the 
following  command; 

cd  <FLITE_HOME> 
autoreconf 

Developers  working  with  Elite  1.5.6  and  Dari  Clustergen  can  skip  to  the  next  step.  But 
developers  using  Elite  1.9.0  or  Dari  Unit  Select  must  make  additional  changes. 

Eor  developers  migrating  Dari  Unit  Select,  the  following  update  is  required  to  compile; 

Edit  < emu  dari  transtac  male  cll2t>/flite  g7  21vuv/Makefile 

An  environment  variable  called  “ANDROID_NDK_SYSROOT”  is  used  in  this  edit.  A 
developer  does  not  need  to  explicitly  add  this  environment  variable  to  the  system;  it  is 
added  automatically  as  part  of  the  build  process  by  Elite. 

At  line  100  (actual  line  number  may  vary),  change  the  lines 

$ (VOICENAME)_lpc.o;  $ (VOICENAME) _lpc . C 

$(CC)  -I.  -1$ (FLITEDIR) /include  -c  -o  $@  $< 

to 

$ (VOICENAME)  Ipc.o;  $ (VOICENAME)  Ipc.c 

$(CC)  -I.  -1$  (FLITEDIR) /include  hl$  (ANDROID  NDK  SYSROOT) /usr/include|  -c  -o  $@  $< 

On  the  next  line  down,  change  the  lines 

$ (VOICENAME) _mcep.o;  $ (VOICENAME) _mcep . c 

$(CC)  -I.  -1$ (FLITEDIR) /include  -c  -o  $@  $< 

to 

$ (VOICENAME)  mcep.o;  $ (VOICENAME)  mcep . c 

$  (CC)  -I.  -1$  (FLITEDIR) /include  h-I$  (ANDROID  NDK  SYSROOT) /usr/include|  -c  -o  $@  $< 
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Unless  these  library  paths  are  ineluded,  the  following  exeeption  will  be  thrown. 

/ Development /android-ndk-r9d/ tool chains/ arm- linux-androideabi- 4 . 8/prebuilt/linux- 
x86_64 /lib/gcc/arm-linux-androideabi/4 . 8 /include- fixed/ stdio . h : 50 : 23 :  fatal  error : 
sys/cdefs.h:  No  such  file  or  directory 
# include  <sys/cdefs .h> 

Compilation  terminated. 


For  developers  using  Dari-enabled  Flite  Engine  1.9.0  (instead  of  Flite  1.5.6),  the  following 
two  updates  are  required  in  “<FLITE_HOME>/conligure.sub”  to  compile  Elite  for  Android 
platforms  (e.g.,  armeabivVa). 

Edit  #1 

Locate  the  text  at  line  256  (actual  line  number  may  vary): 

I  arm  |  arm[bl]e  |  arme [lb]  |  armv[2-8]  |  armv[3-8] [lb]  | 

armv7 [arm]  \ 

Add  a  new  line  at  the  end  and  paste  the  following  text: 

I  arc  I  arm  |  armeabi  |  armeabiv7a  |  arm[bl]e  |  arme[lb]  |  armv[2345]  | 

armv[345] [lb]  |  avr  \ 

Edit  #2 

Locate  the  entry  at  line  1422  (actual  line  number  may  vary): 

-wince* ) 
os=-wince 

r  r 


Add  a  new  line  at  the  end  and  append  the  following  entry: 

-android* ) 
os=-android 

r  r 


Unless  the  above  two  edits  are  made  in  “<FLITE_HOME>/configure.sub”,  a  developer 
may  encounter  the  following  compilation  exception: 

checking  target  system  type...  Invalid  configuration  ' armeabiv7a-android ' ; 
machine  'armeabiv7a'  not  recognized 

configure:  error:  /bin/bash  ./config.sub  armeabiv7a-android  failed 


2,  Dari  Clustergen  for  “armeabi-android” 

Compile  Flite  for  the  armeabi  platform: 

cd  <FLITE_HOME> 

./configure  --with-langvox=transtac  --target=armeabi-android 

make  clean 

make 
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The  above  command  creates  a  new  directory  called  “<FLITE_HOME>/build/armeabi- 
android/”  and  appropriate  subdirectories  under  it  (Eig.  4). 


C  /Flite/Flite-1.5.6-current_w_1.9.0_Dari_Pashto/build/ 

Name  ▼ 

Size 

Date 

■  ••  B  x86_64-linux-gnu 

3  items 

2  items 

06/05/14  03: 
06/04/14  09: 

Fig.  4  The  “armeabi-android”  folder  created  after  compiling 
Flite  for  armeabi  platform 

Compile  Dari  Clustergen  for  the  armeabi  platform; 

cd  <DARI_CG3_HOME>/flite 

make  clean 

make 


Verify  that  Dari  Clustergen  library,  libcmu_dari_transtac_male_cg3.a,  was  compiled  for 
ARM: 

cd  <DARI_CG3_HOME>/flite 

cp  libcmu_dari_transtac_male_cg3 . a  test/ 
cd  test/ 

ar  -X  libcmu_dari_transtac_male_cg3 . a 
file  cmu_dari_transtac_male_cg3 . o 

cmu_dari_transtac_male_cg3 . o :  ELF  32-bit  LSB  relocatable,  ARM,  EABI5 
version  1  (SYSV),  not  stripped 

Copy  the  new  libcmu_dari_transtac_male_cg3.a  to  Elite  1.5.6.: 

cp  <DARI_CG3_HOME>/ flite/ libcmu_dari_transtac_male_cg3 . a 
<FLITE_HOME>/build/ armeabi-android/ lib 

3,  Dari  Clustergen  for  “armeabivTa-android” 

Compile  Elite  for  the  armeabivVa  platform; 

cd  <FLITE_HOME> 

./configure  --with-langvox=transtac  --target=armeabiv7a-android 

make  clean 

make 


The  above  command  will  create  a  new  directory  named 

“<ELITE_HOME>/build/armeabiv7a-android/”  and  subdirectories  under  it  (Eig.  5). 


[B  /Flite/flite-1.5.6-current_ 

_w_1 .9.0_Dari_Pashto/build/ 

Name 

Size 

Date 

*■  B  armeabi-android 

3  items 

06/05/14  03: 

3  items 

06/05/14  04; 

►  B  x86_64-linux-gnu 

2  items 

06/04/14  09: 

Fig.  1  The  “armeabiv7a-android”  folder  created  after  compiling 
Flite  for  armeabiv7a  platform 
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Compile  Dari  Clustergen  for  the  armeabivVa  platform: 

cd  <DARI_CG3_HOME>/flite 

make  clean 

make 


Verify  that  Dari  Clustergen  library,  libemu_dari_transtac_male_cg3.a,  was  compiled  for 
ARM: 

cd  <DARI_CG3_HOME>/flite 

cp  libcmu_dari_transtac_male_cg3 . a  test/ 
cd  test/ 

ar  -X  libcmu  dari_transtac__male_cg3  .  a 
file  cmu_dari_transtac_male_cg3 . o 

emu  dari_transtac  male_cg3.o:  ELF  32-bit  LSB  relocatable,  ARM,  EABI5 
version  1  (SYSV),  not  stripped 

Copy  the  new  libcmu_dari_transtac_male_cg3.a  to  Flite  1.5.6.: 

cp  <DARI_CG3_H0ME>/ flite/ libcmu_dari_transtac_male_cg3 . a 
<FLITE  HOME>/build/ armeabiv7a-android/lib 

4,  Dari  Clustergen  for  “x86-android” 

Compile  Flite  for  the  x86  platform: 

cd  <FLITE_HOME> 

./configure  --with-langvox=transtac  --target=x8 6-android 

make  clean 

make 


The  above  command  should  have  created  new  directory  “<FLITE_F10ME>/build/x86- 
android/”  and  subdirectories  under  it  (Eig.  6). 


B  /Flite/flite-1.5.6-current_w_ 

^  .9.0_Dari_Pashto/build/ 

Name 

''  Size 

Date 

*■  B  armeabi-android 

3  items 

06/05/14 

B  armeabiv7a-android 

3  items 

06/05/14 

3  items 

06/05/14 

••  B  x86_64-linux-gnu 

2  items 

06/04/14 

Fig.  6  The  “x86-android”  folder  created  after  compiling  Flite  for  the  x86  platform 

Compile  Dari  Clustergen  for  the  x86  platform: 

cd  <DARI_CG3_HOME>/flite 

make  clean 

make 
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Verify  that  Dari  Clustergen  library,  libcmu_dari_transtac_male_cg3.a,  was  compiled  for 
x86: 

cd  <DARI_CG3_HOME>/flite 

cp  libcmu_dari_transtac_male_cg3 . a  test/ 
cd  test/ 

ar  -X  libcmu_dari_transtac_male_cg3 . a 
file  cmu_dari_transtac_male_cg3 . o 

cmu_dari_transtac_male_cg3 .  o :  ELF  32-bit  LSB  relocatable,  [Intel  80386|, 
version  1  (SYSV),  not  stripped 

Copy  the  new  libcmu_dari_transtac_male_cg3.a  to  Flite  1.5.6.: 

cp  <DARI_CG3_H0ME>/ flite/ libcmu_dari_transtac_male_cg3 . a 
<FLITE  H0ME>/build/x8 6-android  /lib 

5,  Dari  Clustergen  for  “mips-android” 

Compile  Flite  for  the  mips  platform: 

cd  <FLITE_HOME> 

./configure  --with-langvox=transtac  --target=mips-android 

make  clean 

make 


The  above  command  will  create  a  new  directory  called  “<FLITE_HOME>/build/mips- 
android/”  and  subdirectories  under  it  (Fig.  7). 

B  /Flite/flite-1 .5.6-current_w_1 .9.0_Dari_Pashto/build/ 

Name  *  Size  Date 

'■  B  armeabi-android  3  items  06/05/14 

B  armeabiv7a-android  3  items  06/05/14 

►  3  items  06/06/14 

'•  Bx86-android  3  items  06/05/14 

Fig.  7  The  “mips-android”  folder  created  after  compiling  Flite 
for  the  mips  platform 

Compile  Dari  Clustergen  for  the  mips  platform: 

cd  <DARI_CG3_HOME>/flite 

make  clean 

make 


Verify  Dari  Clustergen  library,  libcmu_dari_transtac_male_cg3.a,  was  compiled  for  mips: 

cd  <DARI_CG3_HOME>/flite 

cp  libcmu  dari_transtac_male_cg3 . a  test/ 
cd  test/ 

ar  -X  libcmu_dari_transtac_male_cg3 . a 
file  cmu_dari_transtac_male_cg3 . o 

emu  dari_transtac_male_cg3 . o :  ELF  32-bit  LSB  relocatable,  MIPS,  MIPS32 
version  1  (SYSV),  not  stripped 
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Copy  the  new  libemu_dari_transtac_male_eg3.a  to  Flite  1.5.6.: 

cp  <DARI_CG3_H0ME>/ f lite/libcmu_dari_transtac_male_cg3 . a 
<FLITE  HOME>/build/mips-android  /lib 

At  this  point,  the  Dari  Clustergen  library  has  been  eompiled  for  all  CPU  platforms  and  installed 
in  Flite.  All  the  library  eompilations  required  outside  of  Eelipse  are  now  eomplete,  and  we  are 
ready  to  set  up  the  Android  Flite  Engine  and  then  integrate  Dari  Clustergen  to  the  Android  Elite 
Engine. 


7.  Flite  Android  Engine  Setup 


As  mentioned,  the  Elite  Android  Engine  is  a  small  Android  projeet  developed  by  Dr  Parlikar  that 
wraps  Elite  with  Google’s  TTS  layer  and  allows  developers  to  invoke  Elite  voices  in  Android.  It 
also  features  a  user  interface  that  lets  a  user  download  Elite  voices,  select  Elite  voices,  and 
synthesize  a  voice  from  typed  text.  To  be  clear,  the  Elite  Android  Engine  is  not  a  re¬ 
implementation  of  Elite  on  the  Android  platform.  The  engine  still  requires  the  standalone  Elite  as 
a  dependency.  Currently,  there  is  no  easy  way  to  use  Elite  Android  Engine’s  user  interface  to 
import  the  Dari  Clustergen  voice  to  the  Elite  Android  Engine.  The  Dari  voice  must  be  integrated 
in  the  source  code. 

Before  we  can  integrate  Dari  Clustergen  to  the  Elite  Android  Engine,  we  need  to  download, 
compile,  and  verify  that  the  default  version  works  out-of-the-box.  The  Elite  Android  Engine 
project  page,  moderated  by  Dr  Parlikar,  is  found  at  a  public  repository  called  GitHub^  (Pig.  8). 
Pollow  the  instructions  from  the  project  Webpage  to  download  and  set  up  the  Android  Elite 
Engine.  The  project  Webpage  describes  using  Apache  Another  Neat  Tool  (ANT)  to  build  the 
project,  but  we  use  Eclipse  to  import  and  build  the  project.  When  the  archive  fde  is  imported  to 
Eclipse,  an  Android  project  called  “PliteEngine”  is  automatically  created  (Pig.  9). 
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Fig.  8  Flite  Android  Engine  project  available  from  GitHub 
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Fig.  9  Android  Flite  Engine  project  imported  to  Eclipse 


As  soon  as  the  project  is  imported,  the  Flite  Android  Engine  is  able  to  launch  its  main  graphical 
user  interface  (GUI)  without  any  configuration.  But  its  features  will  not  function  because  it  has 
not  been  linked  to  Flite.  One  can  verify  the  Flite  Android  Engine  project  was  imported  to  Eclipse 
correctly  by  launching  the  app  to  a  device.  Successful  launch  displays  the  following  menu  on  the 
device  (Fig.  10).  However,  one  should  not  attempt  to  access  any  features  on  the  app  as  it  will 
throw  an  error  because  the  app  is  not  yet  configured  with  Flite. 
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Fig.  10  Main  page  of  the  Android  Flite  Engine 

Once  the  projeet  import  is  verified,  we  need  to  eonfigure  the  Flite  Android  Engine  and  link  it  to 
the  main  Flite  installation.  This  is  indireetly  aeeomplished  by  generating  Flite  shared  library  file 
(e.g.,  libttsfile.so)  for  eaeh  of  the  CPFl  targets  in  the  Flite  Android  Engine  projeet.  It  is  very 
important  to  generate  the  libttsfile.so  shared  library,  beeause  it  is  the  very  heart  of  the  Flite 
Android  Engine  app  and  it  is  also  what  performs  the  voiee  synthesis  task.  The  Dari  Clustergen 
voiees  ereated  and  saved  in  <FFITE_HOME>  from  the  previous  seetion  are  also  ineluded  in  this 
libttsfile.so  shared  library.  There  are  several  ways  to  generate  the  shared  library.  The  easiest 
method  is  by  allowing  Eelipse  to  generate  it.  The  only  non-intuitive  step  is  initially  eonfiguring 
Eelipse  to  generate  libttsfile.so  as  part  of  the  build  proeess.  Although  the  Flite  Android  Engine 
projeet  will  build  and  run  without  generating  the  shared  library,  the  app  will  erash  and  throw  the 
following  error  onee  the  TTS  funetion  is  invoked; 

j ava . lang . Unsatisf iedLinkError :  Couldn't  load  ttsflite:  findLibrary 
returned  null 


Follow  these  instruetions  to  enable  “CDT  Builder”  (C/C++  Development  Tooling)  in  the  projeet 
properties  seetion  and  build  the  libttsfile.so  shared  library. 

1,  Verify  “CDT  Builder”  is  available  and  enabled. 

View  the  list  of  available  builders  in  the  “Builders”  seetion  in  the  projeet  properties  page. 
There  should  be  a  eheek  box  for  “CDT  Builder”  (Fig.  1 1).  If  “CDT  Builder”  is  not  listed, 
then  proeeed  to  the  next  step.  If  “CDT  Builder”  is  listed,  then  skip  the  next  step. 
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Fig.  1 1  “CDT  Builder”  listed  as  an  available  option  in  the 
FliteEngine  properties  page 


2,  Enable  Android  Native  Support. 

Open  the  “Add  Android  Native  Support”  page  aeeessible  under  the  following; 

FliteEngine  properties  ->  Android  Tools  ->  Add  Android  Native  Support 

Enter  “libttsflite”  as  the  library  name  and  click  “Finish”. 


“CDT  Builder”  should  now  be  included  with  the  available  builders  in  the  “Builders” 
section  in  the  project  properties  page  (Fig.  12.). 


Add  Android  Native  Support 

Settings  for  generated  native 
components  for  project. 


Library  Name:  lib  |libttsflite|  |  .so 


@  Cancel  Finish — '| 

Fig.  12  Adding  Android  Native  Support  to  the  FliteEngine  project 


3.  Build  the  project. 

The  build  command  is  accessible  under  the  following: 

Project  ->  Build  Project 

This  command  now  invokes  <NDK_HOME>/ndk-build  as  part  of  the  project’s  build 
process  and  generates  libttsfile.so  for  each  CPU  target:  armeabi,  armeabi-v7a,  mips,  and 
x86  (Fig.  13). 
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SL  Problems  Tasks  S  Console  S3 


□  Properties 


CDT  Build  Console  [FliteEngine] 

16:21:27  •**•  Build  of  configuration  Default  for  proiect  FliteEngine 
/Development/android-ndk- r9d/ndk-build  all 

Android  NDK:  WARNING:  APP  PLATFORM  android-16  is  larger  than  android:ininSdkVersio 
Android  NDK:  WARNING: Ini/ Android. mk:ttsflite:  non-system  libraries  in  linker  flag 
[armeabi-v7a]  Compile-n-  thumb:  ttsflite  <=  edu  emu  cs  speech  ttsflite  service. cc 
[armeabi-v7a]  Compile++  thumb:  ttsflite  <=  edu_cmu_cs_speech_tts_flite_engine.ee 
[armeabi-v7al  Compile++  thumb:  ttsflite  <=  edu_cmu_cs_speech_tts_flite_voices.ee 
[armeabi-v7a]  Compile+-r  thumb:  ttsflite  <=  edu_cmu_cs_speech_tts_string.ee 
[armeabi-v7a]  StaticLibrary  :  libstdc++.a 
[armeabi-v7aj  SharedLibrary  :  libttsflite.so 

[armeabi-v7a]  Install  :  libttsflite.so  =>  libs/armeabi-v7a/libttsflite.so 


Fig.  13  Building  “libttsflite.so”  in  Eclipse  using  NDK 


4,  Verify  generated  shared  libraries. 

If  the  libttsfile.so  libraries  are  generated  correctly,  they  should  exist  in  the  “libs”  folder 
under  their  corresponding  CPU  target  (Fig.  14). 

Project  Explorer  23  ,  B  ^ 
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►i^sre 

►  iSjni 
'■’felibs 

^  &armeabi 

►  ^  libttsflite.so -[arm/le] 
^  &arnfteabi-v7a 

►  libttsflite.so -[arm/lej 
&mips 

►  ^  libttsflite.so  -  [mips/le] 

▼  (S.X86 

►  <iHibttsflite.so-[x86/le] 

►  (S-obj 


Fig.  14  The  “libttsflite.so”  generated  in  the  FliteEngine  project 

The  Flite  Android  Engine  is  now  set  up  and  ready  for  use.  Out-of-the-box,  the  Flite  Android 
Engine  does  not  contain  any  voices.  Each  voice  must  be  downloaded  separately.  To  do  this,  from 
the  main  menu,  click  on  the  “Manage  Voices”  icon  to  see  a  list  of  downloadable  voices.  As  a 
test,  click  on  the  “male_rms”  icon  to  download  this  English  voice  to  the  device  (Eig.  15). 
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“<  *  11:14 

•  FliteTTS  Voice  Management 

fennale_clb 

Data  Alert:  Download  Size  up  to 
SMB. 

Cancel  Download  Voice 

male_bdl 

male_rms 


Fig.  15  The  “Flite  TTS  Voice  Management” 

page.  Download  a  “male  rms”  English  voice. 


Once  the  “male  rms”  voice  is  downloaded,  go  back  to  the  main  menu  and  click  on  the  “TTS 
Demo”  icon.  The  demo  page  will  be  pre-configured  for  the  English  “male  rms”  voice,  because 
“male  rms”  was  the  only  voice  downloaded.  Click  on  a  sample  English  text  to  hear  the  text 
synthesized  in  an  English  voice  (Eig.  16). 


“  *  11:28 


FliteTTS  Engine 


male_rms 


Click  an  item  hereto  synthesize,  or 
enter  your  own  text  below! 

A  whole  joy  was  reaping,  but 
they’ve  gone  south,  go  fetch  azure 


Fig.  16  The  “TTS  Demo”  page  with  a  “male  rms”  English  voice 

If  there  are  any  errors  that  occur  during  this  test  or  certain  functions  cause  an  error,  environment 
variables  may  be  the  cause.  Verify  that  the  required  environment  variables  (e.g.,  EEITEDIR, 
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FLITE  APP  DIR,  ANDROID  NDK,  and  ANDROID  SDK)  are  defined  in  the  development 
environment.  An  alternative  method  is  to  define  these  variables  direetly  in  the  Android.mk 
configuration  file  in  the  Flite  Android  Engine  project.  Add  the  following  lines  at  the  beginning  of 
the  file: 


FLITEDIR:=/Flite/flite-1.5. 6-current_w_l . 9 . 0_Dari_Pashto 
FLITE_APP  DIR: =/ workspace/ FI iteEngine 
ANDROID  NDK : =/ Development/ android-ndk-r9d 

ANDROID  SDK : =/Development/adt-bundle-linux-x8 6  64-20I4032I/sdk 


8.  Integrating  Dari  Clustergen  Library  into  the  Flite  Android  Engine  Source 
Code 


At  this  point,  the  Dari  Clustergen  voices  are  compiled,  the  libttsfiite.so  shared  libraries  are 
generated,  the  Flite  Android  Engine  compiles  on  Eclipse,  and  English  voices  are  synthesized  on 
an  Android  platform.  The  majority  of  the  developers  interested  in  migrating  Dari  Clustergen  to 
an  Android  platform  will  find  this  section  the  most  pertinent  in  the  entire  report. 

We  acquired  the  instructions  to  add  and  link  the  Dari  Clustergen  voice  from  numerous 
correspondences  with  Dr  Parlikar,  and  these  are  described  in  step  1  and  2.  Step  3  is  a  quick 
“hack”  we  implemented  to  configure  Flite  for  Dari  Clustergen.  This  “hack”  was  due  to  the 
difficulty  creating  a  valid  ISO  639  compliant  Java  Eocale  object  for  Dari.  Other  developers 
integrating  common  widely  used  languages  may  be  able  to  skip  step  3. 

Although  we  described  integrating  Dari  Clustergen,  these  instructions  can  be  used  for  any 
Clustergen  voices.  Again,  Dr  Parlikar  stated  that  these  instructions  are  also  applicable  for  Dari 
Unit  Select  voices,  but  we  were  not  able  to  synthesize  Dari  text  using  Dari  Unit  Select. 

Now  we  describe  steps  to  integrate  Dari  Clustergen  library  in  the  Android  Flite  Engine  source 
code.  This  portion  primarily  involves  editing  source  code  in  Eclipse.  We  describe  changes 
needed  in  each  file  by  showing  before  and  after  edit. 

1.  Edit  <FLITE_APP_DIR>/ jni/Android.mk 

Edit  #1  -  Update  the  definition  of  “EOCAE_EDEIBS”  at  line  74  (actual  line  number  may 
vary). 

This  edit  tells  the  Flite  Android  Engine  project  where  the  Dari  Clustergen  libraries  are 
physically  located. 

“$(FEITE_EIB_DIR)”  refers  to  the  folder  where  we  saved  a  copy  of  Dari  Clustergen  voice 
for  each  CPU  target  (e.g.,  “<FEITE_HOME>/build/armeabiv7a-android/lib”). 
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Before  edit; 


LOCAL_LDLIBS:=  -llog  \ 

$ ( FLITE_LIB_DIR) /libf lite_cmulex . a  \ 

$ ( FLITE_LIB_DIR) /libf lite_usenglish . a  \ 

$ (FLITE_LIB_DIR) /libflite.a  \ 

After  edit: 

LOCAL_LDLIBS:=  -Hog  \ _ 

1$  (ELITE  LIB  DIR)/libcmu  dari  transtac  male  cg3.a|  \ 

$ ( FLITE_LIB_DIR) /libf lite_cmulex . a  \ 

$ (ELITE  LIB  DIR) /libf life  usenglish.a  \ 

$  ( FLITE~LIB~DIR)  /libf lite~cmu_dari_lex . a|  \ 

$ (ELITE  LIB  DIR) /libf life  cmu  dari  lang,^  \ 

$ (FLITE_LIB_DIR) /libflite.a  \ 


2,  Edit  <FLITE_APP_DIR>/ jni/edu_cmu_cs_speech_tts_flite_engine  .  cc 

Edit  #1  -  Add  Dari  language  support  at  line  68  (actual  line  number  may  vary)  of 
edu_cmu_cs_speech_tts_flite_engine.cc. 

In  order  to  add  Dari  language  support,  we  need  to  look  up  the  correct  method  names.  Open 
<FLlTE_HOME>/main/flite_lang_list .  c  and  note  the  name  of  the  Dari  initialization 
method.  We  noted  the  following  method  names  from 

<FLlTE_HOME>/main/f  lite_lang_list .  c .  The  highlighted  method  names  are  used 
in  this  step: 


fold 

cst 


cmu_dari 
lexicon  * 


_lang_init (cst_voice  *v) 
emu  dari  lex  init (void) ; 


void  f lite_set_lang_list (void) 

{ 

f lite_add_lang ( "utf 8_grapheme" , utf 8_grapheme_lang_init , utf 8_grapheme_lex_init ) ; 
f lite_add_lang ("usenglish",usenglish_init, cmulex_init)  ; _ 

|f  lite  add  lang  ( "emu  dari  lang",cmu  dari  lang  init,  emu  dari  lex  init);] 


} 

Three  lines  were  used  in  edu_cmu_cs_speech_tts_flite_engine.ee. 
Before  edit; 

//  Declarations 

extern  "C"  void  usenglish_init (cst_voice  *v)  ; 
extern  "C"  cst_lexicon  *cmulex_init (void) ; 

f lite_add_lang ("eng",usenglish_init, cmulex_init) ; 


After  edit: 

//  Declarations 

extern  "C"  void  usenglish_init (cst_voice  *v) ; 
extern  "C"  cst_lexicon  *cmulex_init (void)  ; _ 

ixtern  "C"  void  cmu_dari_lang_init ( cst_voice  *v) 
jxtern  "C"  cst  lexicon  *cmu  dari  lex  init (void) ; 


flite  add  lang ( "eng" , usenglish  init,cmulex  init); _ 

Iflite  add  lang  ( "emu  dari  lang"7  emu  dari  lang  init,  emu  dari  lex  init)  ;| 
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Edit  #2  -  Enable  the  Dari  linked  voiee  at  line  84  (aetual  line  number  may  vary)  of 
edu_cmu_cs_speech_tts_flite_engine.cc. 

Before  edit: 

loadedVoices  =  new  FliteEngine :: Voices ( 0 , 

FliteEngine: : ONLY_ONE_VOICE_REGISTERED) ; 

After  edit: 

loadedVoices  =  new  FliteEngine :: Voices ( 10 , 

FliteEngine: : ONLY_ONE_VOICE_REGISTERED)  ; 

The  first  parameter  sets  the  maximum  number  of  linked  voices  loaded  to  Elite.  This  is  a 
maximum  number.  It  is  okay  to  set  a  high  number. 

The  second  parameter  should  be  left  as 

“EliteEngine::ONEY_ONE_VOICE_REGISTERED”,  which  specifies  that  Elite  will 
handle  one  voice  at  a  time. 

Edit  #3  -  Add  the  Dari  linked  voice  at  line  87  (actual  line  number  may  vary)  of 
edu_cmu_cs_speech_tts_flite_engine.cc. 

In  order  to  add  the  Dari  linked  voice,  we  need  to  look  up  the  correct  method  names.  Open 
<DARl_CG3_HOME>/f  lite/voxdef  s  .  h  and  note  the  Dari  register  and  unregister  method 
names.  We  noted  the  following  method  names  from 

<DARl_CG3_HOME>/flite/voxdef  s  .  h.  The  highlighted  method  names  are  used  in  this 
step: 

#define  VOXNAME  cmu_dari_transtac_male_cg3 

#define  REGISTER_VOX  Register  emu  dari  transtac  male  cg3| _ 

#define  UNREGISTER  VOX^nregister  emu  dari  _transtac  male'  cg3| 

#define  VOXHUMAN  "transtac_male_cg3" 


Before  edit: 

extern  "C"  cst_lexicon  *cmu_dari_lex_init (void) ; 

loadedVoices  =  new  FliteEngine :: Voices ( 10 , 
FliteEngine: : ONLY_ONE_VOICE_REGISTERED)  ; 

if ( loadedVoices  ==  NULL) 


After  edit: 

extern  "C"  cst  lexicon  *cmu  dari  lex  init (void)  ; _ 

■xtern "C"  cst  voice  ^register  emu  dari  transtac  male  cg3 (const  char| 
*voxdir) ; 

■xtern  "C"  void  unregister  emu  dari  transtac  male  cg3 (cst  voice  *vox) ; 
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loadedVoices  =  new  FliteEngine :: Voices ( 10 , 

FliteEngine: :ONLY  ONE  VOICE  REGISTERED); _ 

loadedVoices->AddLinkedVoice ( "emu  dari_lang",  "AFG",  "dari_cg3", 
register_cmu_dari_transtac_male_cg3 , 
nnregister_cmu_dari_transtac_male_cg3 ) ;| 


if ( loadedVoices  ==  NULL) 


The  first  three  parameters  of  the  “AddLinkedVoiee”  method  are  Language,  Country,  and 
Variant.  These  three  values  are  used  by  the  Flite  Android  Engine  to  ereate  a  Java  Loeale 
objeet.  Technically,  we  are  supposed  to  use  ISO  639  compliant  Language  and  Country 
values,  but  the  values  we  used  are  not  ISO  639  compliant  because  we  are  integrating  Dari. 
This  issue  is  discussed  further  in  a  later  section.  For  our  purpose,  these  parameters  are 
sufficient.  The  string  “dari_cg3”  is  the  identifier  for  Dari  Clustergen. 

3.  Edit  <FLITE_APP_DIR>/src/edu/cmu/cs/speech/tts/flite/FliteTtsService . java 

Edit  #1  -  Add  a  conditional  check  for  “dari_cg3”  in  the  onSynthesizeText  method  at  line 
132  (actual  line  number  may  vary). 

This  step  can  be  skipped  for  developers  who  are  able  to  create  a  valid  Java  Locale  object 
using  the  integrating  language.  The  existing  code  will  be  able  to  configure  Flite  for  that 
language.  However,  Dari  Clustergen  requires  modification  because  the  Eanguage  and 
Country  values  we  defined  (from  step  2)  for  Dari  Clustergen  will  not  generate  a  valid  Java 
Locale  object.  Flite  Android  Engine  will  not  invoke  the  set  language  method  for  Dari 
Clustergen  unless  we  make  changes  to  the  project.  Instead  of  making  significant  changes 
throughout  the  project  to  adjust  with  the  current  workflow,  we  chose  to  implement  a  simple 
“hack”  to  minimize  alterations  to  the  Flite  Android  Engine  project.  Existing  code  invokes  a 
set  language  method  using  the  Language,  Country,  and  Variant  values  corresponding  to  the 
selected  voice.  Our  change  simply  over  writes  the  existing  set  language  method  by 
invoking  the  set  language  method  the  second  time  with  correct  values  if  selected  voice  is 
Dari  Clustergen.  Developers  may  wish  to  implement  a  more  elegant  approach  to  avoid 
hard-coding  language  and  country  values.  The  important  take  away  is  that  the  set  language 
method  must  be  invoked  with  the  values  previously  defined  for  Dari. 

Before  edit: 

if  ( !  ( (mLanguage  ==  language)  && 

(mCountry  ==  country)  && 

(invariant  ==  variant  )  )  )  { 

result  =  mEngine . setLanguage ( language,  country,  variant); 

1 

if  ( ! result)  { 

Log . e {LOG_TAG,  "Could  not  set  language  for  synthesis"); 


23 


After  edit: 


if  ( !  ( (mLanguage  ==  language)  && 

(mCountry  ==  country)  && 

(invariant  ==  variant  )  )  )  { 

result  =  mEngine . setLanguage (language,  country,  variant); 

} 


if (variant . equals ("dari_cg3") )| _ 

result  =  mEngine . setLanguage ( "emu  dari  lang",  "AFG",  "dari  cg3"); 


if  ( ! result)  { 

Log . e (LOG_TAG,  "Could  not  set  language  for  synthesis"); 


The  Dari  Clustergen  is  now  integrated  into  the  baekend  of  the  Flite  Android  Engine,  and 
the  engine  now  knows  how  to  synthesize  Dari  voice  using  the  Dari  Clustergen  library. 
Even  with  the  changes  made  in  this  section,  a  user  does  not  yet  have  the  ability  to  select 
Dari  Clustergen  among  list  of  other  available  voices  in  the  Elite  Android  Engine  user 
interface.  The  next  section  describes  how  we  added  Dari  as  a  selectable  voice  to  the  Flite 
Android  Engine  without  updating  the  drop  down  list  of  languages  in  the  source  code. 


4,  Edit  <FLITE_APP_DIR>/src/edu/cmu/cs/speech/tts/flite/TTSDemo . java 
(OPTIONAL) 

Edit  #1  -  Add  a  sample  Dari  text  in  the  “buildUI”  method  at  line  143  (actual  line  number 
may  vary)  in  TTSDemo.java. 

This  update  is  completely  optional  and  is  not  required  to  integrate  Dari  Clustergen  to  the 
Android  platform.  It  may  be  difficult  to  test  the  Dari  voice  synthesis  if  the  developer  does 
not  know  how  to  type  Dari.  This  optional  step  helps  non-Dari  speaker  test  Dari  voice 
synthesis.  We  found  this  addition  very  helpful  during  testing  and  debugging  of  the  Dari 
integration.  Instead  of  typing  Dari  text  (assuming  the  developer  knows  how  to  type  Dari) 
each  time  we  wanted  to  test  Dari  voice  synthesis,  it  is  much  quicker  to  click  on  a  pre¬ 
populated  sample  Dari  text. 

Eor  developers  who  do  not  know  how  to  type  Dari,  there  is  a  sample  Dari  text  file  in 
<DARl_CG3_HOME>/dari  .  txt.  Open  the  file  and  copy  a  line  of  Dari  text.  We  copied  the 
following  line  from  the  file: 

pi  lj  0  p  '  ^  p^  pt5‘-^Uti  P  J  '  U<-5  ^  ®  J  J  (j  '  J  ‘t’  '  C^<-5  ^  ‘  j  J  ' 

2. '  ^  '  j  ‘  '  J  P  '  3  U^dd  '  U  P  '  ‘t’J  '  ^  ^  P  ^  P  '  0^*^  * 
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Before  edit; 

setContentView (R. layout . activity_tts_demo) ; 

mStrings . add ( "Click  an  item  here  to  synthesize,  or  enter  your  own  text 
below ! " ) ; 


After  edit; 

setContentView (R. layout . activity  tts  demo); _ 

BStrings  .  add  ( "f'  lAf''  ju^' J  j^J j' 

Ij  Ij  j  lAf''  Mj'lS  fV  )  ! 

mStrings . add ( "Click  an  item  here  to  synthesize,  or  enter  your  own  text 
below ! " ) ; 


This  update  adds  the  Dari  text  in  the  list  of  pre-populated  texts  for  quick  testing  (Fig.  17). 
Note  that  the  Flite  Android  Engine  does  not  yet  have  the  ability  to  set  language  for  Dari 
(i.e.,  the  Flite  Android  Engine  will  not  speak  Dari  even  if  a  user  clicks  on  this  Dari  text). 
That  feature  is  added  in  the  next  section. 


*  10:42 


Flite  TTS  Engine 


male_rms 


jl  4aAl>  Ijjj 

Click  an  item  here  to  synthesize,  or 
enter  your  own  text  below! 

A  whole  joy  was  reaping,  but 
they’ve  gone  south,  go  fetch  azure 


Fig.  17  Sample  Dari  text  added  to  pre¬ 
populated  list  of  text  for  quick  testing 


9.  Adding  Dari  Clustergen  as  a  Selectable  Voice  in  the  Flite  Android  Engine 
Without  Coding 


At  this  stage  in  the  process,  the  Android  device  recognizes  the  Elite  Android  Engine  as  a 
selectable  TTS  Engine  (e.g.,  Google  TTS  Engine)  in  the  device  settings  and  the  Elite  Android 
Engine  now  knows  how  to  synthesize  a  Dari  voice.  However,  the  Flite  Android  Engine  does  not 
know  that  Dari  is  a  selectable  voice,  because  this  voice  is  not  available  for  download  like  other 
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English  voices.  The  Dari  Clustergen  voiee  does  not  have  a  eorresponding  Flitevox  data  hie, 
whieh  is  the  resouree  needed  to  synthesize  a  particular  voice.  The  Elite  Android  Engine  assumes 
that  each  voice  is  equipped  with  a  Elitevox  data  file,  and  it  is  downloaded  to  the  Android  deviee 
when  a  user  chooses  to  enable  that  voice.  For  example,  when  a  user  ehooses  to  enable  the 
“male  rms”  English  voiee,  a  2.83-MB  file  called  “male_rms. eg. flitevox”  is  downloaded  to  the 
“/sdeard/flite-data/eg/eng/USA”  folder  (Fig.  18).  To  add  Dari  as  a  seleetable  voiee.  Elite  Android 
Engine  must  be  modified  to  address  the  absence  of  a  Dari  Flitevox  data  file. 


Fig.  18  “male  rms”  flitevox  file  downloaded  to  “/sdcard/flite-data/cg/eng/USA” 

Initially,  we  attempted  to  modify  the  Elite  Engine  souree  eode  to  add  the  Dari  voiee,  essentially 
making  Dari  Clustergen  a  permanent  feature  of  the  Elite  Android  Engine.  This  approach  seemed 
like  an  easy  straightforward  update — add  Dari  Clustergen  to  the  list  of  available  voiees  and  add 
eonditions  to  ignore  the  missing  Dari  Flitevox  data  file.  But  we  did  not  anticipate  how  extensive 
the  Flitevox  data  file  was  verified  and  refereneed  throughout  the  project.  The  Elite  Android 
Engine  verifies  the  integrity  of  each  Flitevox  file  by  eomparing  its  MD5  eheeksum  against  the 
expeeted  value,  and  it  is  referenced  in  many  places  throughout  the  eode.  We  updated  the  eode  to 
ignore  the  MD5  check  for  Dari  and  started  adding  several  eonditions  to  specifically  ignore  the 
missing  Dari  Flitevox  file.  This  approaeh  quiekly  beeame  diffieult  to  manage  with  numerous 
eonditional  cheeks  spread  throughout  the  project.  It  also  would  have  likely  caused  bugs  when 
ehanges  were  required  later.  In  addition,  it  was  not  possible  to  ereate  an  exaet  ISO  639-2 
compliant  Dari  Locale  object,  which  is  needed  to  invoke  any  TTS  Engine  on  Android.  Several 
Language  and  Country  eombinations  vaguely  similar  to  Dari  were  attempted  (e.g..  Language  = 
“prs”  +  Country  =  “fa”.  Language  =  “per”  +  Country  =  “fa”),  but  they  threw  a 
“MissingResource”  exeeption  (Fig.  19).  In  order  to  bypass  the  exeeption  and  continue  testing,  we 
ereated  a  Locale  using  Language  =  “ar”  and  Country  =  “DZ”  even  though  these  were  not 
equivalent  to  Dari.  Due  to  manageability  eoneems,  we  eventually  decided  to  abandon  this 
approaeh. 
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Couldn't  retrieve  ISO  639-2/T  language  code  for  locale:  pr3_FA_cg3 

java. util. MissingReaourceException:  Ho  3-letter  language  code  for  locale:  pra  [ 

_FA_cg3 

at  java. util. Locale. getIS03Language (Locale. ]ava: 540) 

at  android. speech. tt3.TextToSpeech$9. run (TextToSpeech. java: 1144) 

at  android. speech. tt3.TextToSpeech$9. run (TextToSpeech. java: 1136) 

at  android. speech. tt3.TextToSpeech$Connection. runAction (TextToSpeech. java: 15  [ 

95) 

at  android. speech. tts .TextToSpeech. runAction (TextToSpeech. java: 629) 
at  android. speech. tts. TextToSpeech. runAction (TextToSpeech. java: 619) 
at  android. speech. tts. TextToSpeech. setLanguage (TextToSpeech. java: 1136) 
at  edu. emu. cs. speech. tts. flite.TTSDemo . sayText (TTSDemo. java: 188) 
at  edu. emu. cs. speech. tts. flite.TTSDemo . onListltemCliclc (TTSDemo . java: 281) 


Fig.  19  MissingResourceException  while  attempting  to  create  a  Locale  object 

The  integration  solution  we  ehose  was  a  mueh  simpler  workaround  that  only  required  two  lines 
of  additional  eode  in  the  Android  Flite  Engine  projeet.  We  ereated  a  MD5 -valid,  but  non- 
funetioning,  Flitevox  plaeeholder  for  the  Dari  voiee  so  that  the  Flite  Android  Engine  lists  and 
aeeepts  Dari  as  a  valid  request.  The  Flite  Android  Engine  will  think  that  it  is  a  valid  Flitevox  file. 
We  allow  the  Flite  Android  Engine  to  validate  the  Dari  voiee  request  using  the  surrogate 
Flitevox  file.  After  the  validation  eheeks  are  eomplete,  we  divert  the  request  to  the  real  Dari 
Clustergen  linked  library  instead  of  the  surrogate  Flitevox  file.  With  this  approaeh,  adding  future 
voiees  is  very  manageable,  requiring  ehanges  to  a  single  line  of  eode.  However,  this  solution 
requires  some  file  manipulations  and  editing  on  the  deviee.  This  seetion  deseribes  the 
workaround  to  adding  Dari  Clustergen  voiee  to  the  Flite  Android  Engine. 

1 .  Start  the  Flite  App. 

2.  Go  to  the  “Mange  Voiees”  page. 

3.  Download  any  voiee  (if  not  already  downloaded). 

For  this  example,  we  will  referenee  “male  rms  English  (United  States)”. 

4.  Use  a  text  editing  app  to  open  the  voices-20120731 .  list  (Fig.  20). 

This  file  eontains  all  information  about  the  list  of  downloadable  voiees  (e.g.,  Fanguage, 
Country,  Variant,  MD5  eheeksum,  ete.). 

The  preeise  loeation  of  this  file  may  slightly  vary  depending  on  the  deviee. 

On  this  partieular  deviee  it  was  loeated  in  the  following: 

/sdcard/flite- data/ eg /voices-20120731. list 
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flite*data 


eg 


© 


Fig.  20  voices-20120731.1ist  located  in  /sdcard/flite-data/cg 


5.  Copy  the  line  that  defines  the  “male  rms  English  (United  States)”  voiee  and  paste  it  at  the 
end  of  the  file.  On  the  line  that  was  just  pasted,  replaee  the  string  “male_mis”  with 
“dari_eg3”.  Save  and  elose  the  file.  Both  “male_rms”  and  “dari  egS”  will  share  the  same 
MD5  hash  value  (Fig.  21). 


eng-CAN-malejmkb9d1 5ebe6f2487cf3fbd19c370tdfca2 
eng-DEU-male_ahw  c81 1 3b04655460ecl  fl  a0e941  bcl  d393 
eng-DEU-male_fem4af4f7c49fa9be5 1  bl  2e36ce4cl  743a7 
eng-GBR-male_awb  2d8dd2f756dba730eeb9d2a8dcl  a7069 
eng-IND-male.aup  7ae4821ea3db4ad2e923f6aca7b9cfdd 
eng-IND-male.gka  6a084b772d6b1 1 61 6984a2b35d4c79df 
eng-IND-male_ksp  Idc7cb5cce34bl  10f2bdd0da0e6ad3fa 
eng-ISR-male_rxr  Ie5bb41468c9dfd936fa4721746b4dca 
eng-USA-female_clb  56752c30ba0f88ace2cc6803ae4c4381 
eng-USAfemale_slt  f452c56a55bfe30153e21f7677c9f2b4 
I  i?,A  wwlc  bdl  00d0ogbbQ7d7O666ia0ffab6fOn974a^ 
eng-USA-male_rmsel01d5ba0d6c4496841f3ea5023c9245 
eng-USA-darLcg3  el01d5ba0d6c4496841f3ea5023c9245 


Fig.  21  Add  an  entry  for  “dari_cg3” 


6.  Use  a  folder  browsing  app  to  go  to  the  downloaded  file  from  step  3. 
On  this  partieular  deviee  it  was  located  on  the  following; 

/sdcard/flite-data/cg/eng/USA/male_rms . eg . f litevox 


Copy  “male_rms.cg.flitevox”  and  save  it  as  “dari_cg3.cg.fiitevox”  (Fig.  22). 
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oDlV 


▼  I 


r 


dari_cg3.cg.flitevox 


male.bdi.cg.flitevox 


male_rms  eg  .fl  itevox 


Fig.  22  Copy  “male  rms.cg.flitevox”  and  save  as  “dari  cgS.cg.flitevox” 

7.  Intercept  request  for  “dari_cg3”  voice  synthesis. 

This  code  update  was  made  in  the  previous  section.  It  is  repeated  here  to  simply  explain 
how  “dari_cg3.cg.flitevox”  file  is  used  to  update  the  Flite  Android  Engine  GUI. 

Add  the  following  code  at  line  132  (actual  line  number  may  vary)  in  the  method; 

onSynthesizeText  (SynthesisRequest,  SynthesisCallback)  in  FliteTtsService.java. 

It’s  very  important  to  use  the  same  Language,  Country,  and  Variant  parameters  used  to  add 
the  Dari  Clustergen  to  the  voice  list  in  the  edu_cmu_cs_speech_tts_flite_engine.ee  file.  In 
earlier  section,  we  defined  Dari  Clustergen  by  specifying  “cmu_dari_lang”  as  Language, 
“AFG”  as  Country,  and  “dari_cg3”  as  Variant. 

Before  edit: 

if  ( !  ( (mLanguage  ==  language)  && 

(mCountry  ==  country)  && 

(invariant  ==  variant  )  )  )  { 

result  =  mEngine . setLanguage ( language,  country,  variant); 

} 


if  ( ! result)  { 

Log . e {LOG_TAG,  "Could  not  set  language  for  synthesis"); 


After  edit: 

if  ( !  ( (mLanguage  ==  language)  && 

(mCountry  ==  country)  && 

(mVariant  ==  variant  )  )  )  { 

result  =  mEngine . setLanguage (language,  country,  variant); 


} 


if (variant . equals ( "dari_cg3" ) ) 

result  =  mEngine . setLanguage ( "cmu dari lang" ,  "AFG",  "dari cg3"); 


if  (  ! result)  { 

Log . e (LOG_TAG,  "Could  not  set  language  for  synthesis"); 
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8.  Compile  and  run  the  app. 


The  Flite  TTS  Voiee  Management  page  will  now  list  “dari  egS”  as  a  seleetable  option 
(Fig.  23).  Note  that  Management  page  shows  “English  (United  States)”  assoeiated  with 
“dari  egS”.  This  is  a  side  effeet  of  using  “male  rms”  English  voiee  as  a  souree  of  the  Dari 
surrogate  Elitevox  file.  The  English  indieator  ean  be  safely  ignored.  Management  page  also 
shows  that  the  voiee  is  already  downloaded,  because  the  dari_cg3 .  eg.  fiitevox  exists  on 
the  device. 


Fig.  23  Dari  listed  as  selectable  voice  in  the  Flite  TTS  Voice  Management  page 
The  Elite  TTS  Engine  page  will  list  “dari  egS”  as  a  selectable  option  (Eig.  24). 
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D  ■ 

▼  Q  4:45 

^  I  Flite  ITS  Engine 

male_bdl 

A 

male_bdl 

male.rms 

dari.cgS 


jl  Jo  0015:0  Ij  SjS  U-i  4j  lo 

.OOol  jO^  5  CUol&O  3I  Oljl>^l  (OOol&O 


Click  an  item  here  to  synthesize,  or  enter  your  own  text  below! 


A  whole  joy  was  reaping,  but  they've  gone  south,  go  fetch  azure 
mike! 


Fig.  24  Dari  listed  as  selectable  voice  in  the  Flite  Demo  app 


Now  select  “dari  cgS”  as  the  Flite  engine.  Click  on  a  pre-populated  sample  Dari  text  to 
hear  the  voice,  or  use  a  Dari  keyboard  (Fig.  25)  to  enter  any  Dari  text. 


jl  4&oL>  l^j  b  SjS  IaJj  4j  lo 

.".  ..tl  4a,at^  ■*  •. "1 .  .1  ^  .  **. . .,! A  jl  oblsoPl  a  .a 

Click  an  item  here  to  synthesize,  or  enter  your  own  text  below! 

A  whole  joy  was  reaping,  but  they’ve  gone  south,  go  fetch  azure 
mike! 
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Fig.  25  Using  a  Dari  keyboard  to  type  Dari  text 


Dari  Clustergen  is  now  a  selectable  voice  from  the  Flite  Android  Engine. 
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10.  Invoking  Flite  Voices  from  an  External  Android  App 


Once  the  Android  Flite  Engine  is  able  to  invoke  a  Dari  voice,  it  is  ready  to  integrate  with  any 
Android  app.  Fortunately,  the  Android  Flite  Engine  was  designed  following  the  Android  ITS 
engine  guideline.  As  a  result,  invoking  a  Flite  voiee  from  an  external  app  is  relatively 
straightforward.  The  Android  Flite  Engine’s  projeet  page  very  briefly  describes  this  process: 

“If you  are  developing  an  application  and  would  like  to  use  Flite  for  speech  synthesis, 
you  can  specify  ‘edu.cmu.es. speech.tts.flite’  as  the  package  name  of  the  engine  to  use. 

This  instruetion  implies  that  a  developer  eould  invoke  the  Flite  Engine  regardless  of  whieh  TTS 
engine  was  set  as  default  on  the  deviee.  However,  we  encountered  a  problem  with  this  approach 
and  found  that  a  device’s  default  TTS  engine  setting  played  an  important  role  for  this  task.  For 
example,  the  Flite  Dari  voice  method  invoeation  did  not  work  when  the  device’s  preferred  TTS 
engine  was  set  to  “Google  Text-to-Speeeh  Engine”,  even  though  the  TextToSpeech  object 
accepted  the  “edu.cmu.es. speeeh.tts. flite”  package  name  without  throwing  an  exception.  In  fact, 
the  “setEngineByPackageName”  method  returned  “SFICCESS”  and  there  were  promising  status 
messages  in  the  log,  but  it  did  not  synthesize  the  Flite  voiee. 

In  order  to  invoke  the  Flite  Dari  voiee,  the  device’s  default  TTS  engine  had  to  be  set  to  “Flite 
TTS  Engine”.  Then,  it  was  no  longer  neeessary  to  set  “edu.emu.es. speeeh.tts. flite”  paekage  name 
on  the  TextToSpeech  object.  As  a  side  note,  Google  may  be  diseouraging  developers  from 
directly  specifying  a  TTS  engine  using  a  package  name,  beeause  the 

“setEngineByPackageName”  method  has  been  depreeated  sinee  Android  API  14.  The  downside 
to  this  approaeh  is  that  “Flite  TTS  Engine”  must  be  the  default  TTS  engine  (i.e.,  the  developer’s 
Android  app  will  not  fully  function  unless  the  deviee’s  preferred  TTS  engine  is  set  to  “Flite  TTS 
Engine”). 

What  follows  is  a  step-by-step  instruction  on  how  to  invoke  Flite  Dari  voice  from  a  separate 
Android  app. 

1.  Configure  device’s  preferred  TTS  engine  (Fig.  26)  to  “Flite  TTS  Engine”: 

Device  Settings  ->  Fanguage  &  input  ->  Test-to-speech  output  ->  PREFERRED  ENGINE  - 
>  choose  “Flite  TTS  Engine” 
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>  ■ 

▼  Q  3  48 

TexMo-speech  output 

PREFERRED  ENGINE 

Google  Text-lo-speech  Engine 
SVOX  Classic  TTS 


Fig.  26  Device's  preferred  TTS  engine  settings  page 

2.  Instantiate  a  TextToSpeech  object  in  the  Activity’s  Java  class.  The  mTextToSpeech  object 
will  assume  it  is  using  Flite  TTS  Engine  and  “edu.cmu.es. speech.tts.flite”  does  not  need  to 
be  set  as  the  TTS  Engine  package  name. 

The  Dari  Clustergen  voice  is  specified  by  the  Locale  object.  Else  the  same  Language, 
Country,  and  Variant  string  used  to  name  the  Elitevox  placeholder  file  (Fig.  27)  to  create  a 
Locale  object.  Recall,  “eng”  was  used  as  Language,  “USA”  was  used  as  Country,  and 
“dariegS”  was  used  as  Variant.  Full  path  of  the  “daricgS.cg.fiitevox”  file  on  the  Android 
device  can  be  used  to  help  identify  the  correct  Language,  Country,  and  Variant  values  to 
use. 


Fig.  27  Flitevox  placeholder  fde  for  Dari  Clustergen.  Language,  Country, 
and  Variant  values  found  in  the  fde  path 

The  following  is  a  sample  of  the  line  involved; 

protected  void  onCreate (Bundle  savedInstanceState )  { 

super . onCreate (savedInstanceState) ; 

private  TextToSpeech  mTextToSpeech  =  new  TextToSpeech (this,  new 
OnInitListener ( )  { 

public  void  oninit  (int  status)  { 

if (status  ==  TextToSpeech. SUCCESS)  { 

int  result  =  TextToSpeech . setLanguage (ne^ 

^Bcale  ("eng"  ,  "USA"  ,  "dari__cg3"  ) ) 

if(  result  ==  TextToSpeech . LANG_MISSING_DATA  || 

result  ==  TextToSpeech. LANG_NOT_SUPPORTED) { 

Log . d ( "TTS" , "This  Language  is  not  supported  by  the  Text- 

to-Speech  engine."); 

} 

}  else { 

Log . d ( "TTS ", "Could  not  initialize  Text-to-Speech  engine."); 

} 
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The  TextToSpeech  object,  mTextToSpeech,  exposes  methods  to  control  pitch  and  speech 
rate.  These  options  would  have  been  valuable  to  dynamically  adjust  the  voice,  but 
unfortunately  they  did  not  appear  to  affect  the  Flite  Dari  voice.  We  attempted  to  reduce  the 
speech  rate  by  50%,  but  the  synthesized  Dari  Voice  remained  unchanged. 

3.  Invoke  the  speak  method.  Once  the  TextToSpeech  object  is  configured,  synthesizing  Dari 
text  is  easily  accomplished  by  single  line  of  code: 

mTextToSpeech  .  speak  (  o^jj6\s"  ,  TextToSpeech  .  QUEUE_FLUSH,  null); 


11.  Conclusion 


This  report  described  all  the  steps  required  to  integrate  a  Dari  Clustergen  voice  to  the  Flite 
Android  Engine.  This  lengthy  and  convoluted  process  involved  transferring  Dari  from  Flite  1.9.0 
to  Flite  1.5.6,  making  changes  to  the  project  source  code,  and  then  compiling  Flite  for  multiple 
CPU  targets. 

If,  in  the  future,  Dari  is  available  in  Flitevox  format,  then  there  would  be  no  need  for  these 
integration  instructions.  A  user  would  simply  download  the  Dari  Flitevox  file  to  their  device  and 
the  Flite  Android  Engine  would  automatically  list  Dari  as  a  selectable  language  and  know  how  to 
synthesize  Dari  text.  This  is  exactly  how  the  Elite  Android  Engine  currently  works  for  the  12 
English  voices.  Unfortunately,  Dari  Clustergen  is  not  available  in  the  Elitevox  format. 

Even  though  this  report  focuses  on  migrating  Dari  Clustergen  to  Android,  it  applies  to  other 
voices  as  well.  In  addition,  this  report  described  numerous  problems  we  encountered  during  the 
migration  process  and  workaround  solutions  that  may  help  some  developers  doing  similar  work. 
In  the  end,  our  migration  effort  was  successful  and  we  were  able  to  extend  our  work  to 
synthesize  the  Dari  Clustergen  voice  from  our  Dari  Phrase  Book  Android  app. 
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List  of  Symbols,  Abbreviations,  and  Acronyms 


ADT 

Android  Development  Tool 

ANT 

Another  Neat  Tool 

API 

applieation  programming  interfaee 

ARL 

US  Army  Researeh  Laboratory 

CMU 

Carnegie  Mellon  University 

CPU 

eentral  proeessing  unit 

Flite 

Festival  Lite 

GUI 

graphieal  user  interfaee 

IDE 

Integrated  Development  Environment 

NDK 

Native  Development  Kit 

TTS 

text-to-speeeh 
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1  DEFENSE  TECH  INFO  CTR 

(PDF)  ATTN  DTICOCA 

2  US  ARMY  RSRCH  LABORATORY 

(PDF)  ATTN  IMAL  HRA  MAIL  &  RECORDS  MGMT 
ATTN  RDRL  CIO  LL  TECHL  LIB 

1  GOVT  PRNTG  OFC 

(PDF)  ATTN  A  MALHOTRA 

3  US  ARMY  RSRCH  LAB 

(PDF)  ATTN  RDRL  CUB  MICHAEL  LEE 

ATTN  RDRL  CII  B  R  WINKLER 
ATTN  RDRL  CII  B  S  LAROCCA 
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